Papers with stress tests question answering
Multi-VALUE: A Framework for Cross-Dialectal English NLP (2023.acl-long)
Copied to clipboard
| Challenge: | Current systems that focus on standard American English are not dialect invariant . current systems focus on a single dialect, which results in performance discrepancies . |
| Approach: | They propose a resource for evaluating and achieving English dialect invariance . they stress test question answering, machine translation, and semantic parsing . |
| Outcome: | The proposed system is based on a rule-based translation system spanning 50 English dialects and 189 unique linguistic features. |